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The difference in cognitive resources required for 
imagination and perception was tested in two experiments by examining 
the reduced substitutability of imagination and perception in problem 
solving by college undergraduates. Eighty subjects in Experiment 1 
drew capital letters from lines or descriptions of lines in a 
seven'-page booklet. The results indicate that imagined information 
and perceived information were integrated with equivalent accuracy 
and strategies. When the problems became more cognitively demanding 
and mental combinations of lines into figures contained four 
elements, different strategies were used. Sixty-eight subjects were 
given explicit instructions on how to identify imagined or perceived 
lines as letters. When strategies were restricted, integrating 
imagined information was less accurate than integrating perceived 
information. Several factors, many of which were related to the 
cognitive demand difference from these two origins, influence the 
substitutability of imagination and perception. To describe cognitive 
processing of information from internal and external origins, 
researchers should use multiple performance measures. (SLD) 
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Abstract 



The difference In cognitive resources required for 
imagination and perception was tested in two experiments by 
examining the reduced stibst i tutabi 1 i ty of imagination and 
perception when solving problems. The results of Experiment I 
Indicated that when the problems were easy. Imagined and 
perceived information was integrated with equivalent accuracy and 
strategies. When the problems were more cognltively demanding, 
the accuracy of Integrating Information from the internal and 
external origins was equivalent but different types of strategies 
were used. Experiment II showed that when the strategies were 
restricted, integrating imagined information was less accurate 
than integrating perceived information. The conditions that 
affect the subst 1 tutabi 1 1 ty of imagination and perception are 
discussed along with the metacogni t I ve process of optimizing the 
use of cognitive resources In solving problems. 
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Abstract 



The difference In cognitive resources required for 
imagination and perception was tested in two experiments by 
examining the reduced stjibst i tutabi ti ty of imagination and 
perception when solving problems. The results of Experiment I 
indicated that when the problems were easy, imagined and 
perceived information was integrated with equivalent accuracy and 
strategies. When the pj^oblems were more cognltively demand ing* 
the accuracy of Integrating Information from the internal and 
external origins was equivalent but different types of strategies 
were used. Experiment II showed that when the strategies were 
restricted, integrating imagined information was less accurate 
than integrating perceived information. The conditions that 
affect the subst i tutabi I i ty of Imagination and perception are 
discussed along with the metacogni t i ve process of optimizing the 
use of cognitive resources in solving problems. 
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The origin of Information and Its effect on problem solving 

Gerard L. Han ley 
California State University, Long Beach 

Flnke (1980), Marks <1977> and Shepard & Podgorny (1978) are 
among the many researchers who have proposed that the qualities 
of the Images and perceptions very similar and the cognitive 
processing of Images and the perceptUrJ processing of visual 
stimuli Involve many of the same component processes. These 
similarities would permit saam degree of subst 1 tutabl 1 1 ty of 
imagination and perception. The concept of subst 1 tutabl 1 1 ty has 
been developed in economic and behavioral models and refers to 
the amount of exchangabl I 1 ty in the value of products or 
behaviors (see Rachlin* Kagel, & Dattallo, 1980 for a detailed 
description of subst 1 tutabl 1 1 ty). One Implication of a high 
degree of subst 1 tutabl I 1 ty within a cognitive perspective is that 
people could exchange information from an internal origin 
( ima Mnat Ion) with Information from an external origin 
(perception) without a change in cognitive processes and 
behavior. The studies on mental rotation (Shepard & Cooper, 
1982) and visual image construction (Murphy & Hutchinson, 1982; 
Peterson, Holsten, & Spevak, 1975) have demonstrated the 
similarities between mentally transforming imaginations and 
perceptions and support the hypothesis that imagination and 
perception were highly subst 1 tutabl e « 
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There are differences between Imagination and perception 
which are also Important to Identify. Johnson & Raye (1981) 
proposed that one difference Is the amount of cognitive 
operations required to generate memories from imagination and 
perception; Imagination typically requires more effortful 
operations while perception typically involves automatic 
operations. Furthermore* the effortful cognitive operations 
require more of a person^s limited cognitive resources than 
automatic operations (Hasher & Zacks, 1979}. Baddeley^s (1981) 
and Baddeley & Hitches (1974) model of limited capacity of 
working memory, and Kahncman^s (1973), and Norman and Bobrow's 
(1975) concept of resource limitation all reflect this general 
limitation in cognitive resources. The difference in cognitive 
resources required for imagination as compared to perception 
could decrease the subst 1 tutabl 1 1 ty of imagination and perception 
when the resource demands of the problem exceed the individual's 
available resources. Consequent I y » problem solving behavior and 
cognitive strategies might be different when solving problems In 
one's head versus in the environment. 

Imagination and perception occur during the construction of 
the initial state, the goal state, and the problems space, the 
three components of problem solving (Newell & Simon, 1972). Th-* 
initial state represents the available information concerning the 
solver'^s present circumstance. It is composed of information 
from both origins, the memories and Imaginations activated by the 
perceptions of the immediate environment. A problem is created 
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when the goal state Is not the same as the Initial state. The 
goal state represents the desired circumstance and the origin of 
the goal state Is fundamentally internal. Since a person can 
not perceive what does not phvslcally exist and the goal state 
does not yet exist » the goal state can only be Imagined. 

The problem space is the third component of problem solving 
and refers to the set of strategies from which the individual 
must select and execute in order to transform the inital state 
into the goal state. The problem space can be represented by 
Information from Interal as well as external origins. If an 
Individual Is mentally manipulating the Initial state to create 
the goal state* the individuates strategy is of an Internal 
origin. If the individual is physically operating on his or her 
environment to create the goal state, the individual's strategy 
Is of an external origin. Often* the problem space is composed 
of Internally as well as externally generated strategies. 

Once the goal is defined and strategy executed, the solver 
must recognize when the transformed initial state has become the 
goal state. This recognition process is a basic component of 
means-ends analysis. In sum, problem solving involves the 
generation of the initial state, the transformation of the 
Initial state, and the recognition of the goal, with each process 
using information from Internal and/or external origins. 

The subst 1 tutabi 1 1 ty of imagination and perception is an 
Important issue in problem solving because there are always time 
and resource limitations placed on the solver. That is, people 
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solve problems In a closed rather than open system. Burkhard^ 
Rachlln» & Schrader (1978) and Rachlln 8. Burkhard (1978) have 
made this same point In developing their behavioral model and 
many of the Issues raised In the present cognltWe perspective of 
problem solving have their parallel In Rachlln^^ behavioral model 
of choice. The focus of the present experiments Is the 
reallocation of cognitive resources caused by solving problems 
within a closed system. If all resources are utilized In 
performing multiple activities and an Increased allocation of 
resources Is required for one activity, there must be a decreased 
allocation of resources for other actlvtles. 

If Imagination and perception are completely subst 1 tutabl e 
then there would be no need to reallocate cognitive resources » 
The generation of Inltal and goal states* the transformation of 
the Initial state, and the recognition of the goal state should 
be the same when Imagining and perceiving the same Information 
content. But If Imagination does require more cognitive 
resources, the required resources must be subtracted from other 
cognitive actlvltes. Imagining the Inltal state should lead to a 
decrement In the tranf ormat Ion and/or recognition processes as 
compared to perceiving the Initial state. 
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* Experiment I 

SutLlssla^ Eighty undergraduates at the C.S.U. , Long Beach 
received course credit for their participation. 

ttat;grUla, Seven-page booklets were constructed with 
either lines or descriptions of lines on each page. The complete 
set of lines consisted of four straight lines (vertical, 
horizontal, sloping up from left to right. 8. sloping down from 
left to right) and four semi-circles (open side facing up. down, 
left, 8. right). When a booklet contained only lines, each page 
had some combination of two lines or some combination of four 
lines. Each page of four lines contained both the lines from the 
two-element subset plus t^o lines that functioned mostly as 
dlstrastors. Matching sets of booklets were constructed which 
presented the verbal descriptions of the lines rather than the 
1 1 nes themse I ves . 

Ec gcg<»ire . Subjects were run in groups of 2 to 5 and were 
randomly assigned to one of the four presentation conditions. 
They were instructed that each page of their booklets had two (or 
four) lines (or descriptions) and their task was to mentally 
combine the lines to form as many upright, capital letters in the 
English alphabet as possible. Subjects were told that they could 
change the relative position and size of the lines and could use 
one or all of the lines when mentally constructing letters. They 
could use the same line more than once when constructing letters 
but tney could not rotate lines when combining them. Subjects 
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had one minute to write down the letters In the order they 
constructed them at the bottom of each page before they were 
Instructed to turn to the next page. 

Aaaizaiai. The letters generated were classified into two 
groups, one-llr.e and two-line letters. The letters C, I, and U 
were one-line letters because they could be Identified from oi.'.y 
one of the presented lines or verbal descriptions. Eight and ten 
one- line letters could be Identified in the two-element and 
four-element conditions, respectively. The letters B, D, E, F, 
H, J. L. M, N, 0, P, S. T, V, W, X, Y, and Z were two-line 
letters because they could be constructed from two different 
lines or verbal descriptions. Twenty and twenty-four two-line 
letters could be constructed in the two-element and four-element 
conditions, respectively. 

To assess the recognition strategy subjects used to Identify 
working memory representations as letters, the order In which the 
letters were constructed was examined. There were two types of 
general strategies; subjects could work forward or work backward. 
If Kubjpcta worked backward, they would start each trial by 
working from the alphabet (the set of goal responses) and 
evaluate If each letter could be decomposed into the set of 
presented lines or descriptions. Since the alphabet has a 
definite sequential structure, the order of the letters 
constructed should be consistent with the order of letters In the 
alphabet If subjects always worked backward, all their 
responses would be alphabetically ordered and they would get 
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scores of 100*, A working forwards strategy would begin with the 
generation and mental manipulation of the elements. The 
recognition of letters would occur if the constructed 
representation matched the features of a letter If subjects 
were working forward from the set o£ lines to the goal of the 
letters, not using any strategy In particular, consecutlvv? 
letters should be alphabetically ordered as often as 
non-alpabet leal 1 y ordered. These subject would get scores equal 
to zero. 
Rggul tg 

Figure 1 shows the mean percent correct Identification of 
one-line letters for each group. Overall > correctly Identifying 
a single line as a letter was significantly more difficult when 
presented with four elements than when presented with two 
elements < f <1,76>= 28.54, b <.05>. There were no slgnflcant 
differences In Identification between the Imagination and 
perception groups In either the two-element condition ( £ (l,38>= 
1-12, B >.10) or four-element condition ( £ (1,38>= 2.16, e 
>.10) [11. 

Figure 2 shows the mean percent correct construction of 
two-element letters. Again, the four-element condition had a 
significantly lower rate than the two-element condition ( £ 
<l,76>a 123.00, ft <.05> and there were no significant 
differences between Imagination and perception In each of these 
conditions ( £ (1,38)< 1.0, £ (1,38>« 2.25, e >.10, 
respectively). There was also no significant difference between 
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the accuracy of one-line and two-Une letters for the two-element 
and four-element conditions ( £ (1,39>= 3.06, a >.05; £ (1,39>< 
1.0, respectively) 

Figure 3 shows the mean percentages of alphabetically order 
letters for all four groups. Overall, subjects In the 
two-element condition had a significantly greater percentage of 
alphabetically ordered sequences than subjects in the 
four-elemeiit condition ( £ (1,76)= 8.55, e <.05>. It was also 
found that subjects Imagiring two lines V€re Just as likely to 
work backward as subjects perceiving two line ( £ <l,38)< 1.0). 
In contrast, subjects who imagined four lines were significantly 
less likely to work backward than those who perceived four lines 
< £ <1,38)= 5.11, E <.05>. 
Discuss ion 

Two conflicting conclusions can be drawn from the findings 
from Experiment I. The accuracy in identifying one- line and 
two-line letters indicates that imagination and perception were 
completely subst 1 tutabl e processes In both the two-element and 
four-element conditions while the measure of working forwards or 
backwards indicates that imagination did not completely 
substitute for perception in the more cognltively demanding task. 

The two mental operations required to recognize one-line 
letters are the generation of each element either by imagination 
or perception and the recognition of an element as a letter. The 
reduced accuracy' of one-line letters in the four-element 
condition probably reflects a decreased accuracy in the 
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recognition process and not In the generation process. The Mnes 
and descriptions were equally dlscrlmlnable In the two-element 
and four-element conditions so the generation of the Individual 
elements should have remained the same. The lower Identification 
of one-line letters may have been produced by subjects having 
difficulty generating all four elements In the one minute period. 
But If time was a major contributing factor. It would be expected 
that the Imagination group should have been less accurate than 
the perception group; reading the four descriptions must have 
taken more time than looking at four lines. This was not the 
case; the performance of the Imagination and perception groups 
was equivalent • 

The greater number of generations probably lead to an 
Increased allocation of cognitive resources to the generation 
processes and consequently decreased the cognitive resources 
available for i?ecogn 1 1 ion • The decrement in one-line letter 
identification was probably due to a reduced ability to compare 
the goal response with the individual elements. 

The Increased resources needed to generate four elements 
could lead to a decreased availability of resources for the 
transformation process. If the transformation process was 
affected, then the two-line letters should have been more 
difficult to identify than the one-line letter in the 
four-element condition. This was not the case. The equivalent 
rates of identifying both types of letters In the two-element and 
four-element conditions indicates that the transformation 
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processes had a high priority and/or the transformation processes 
were relatively effortless. If the accuracy of the generation 
and transformation processes were not compromised, then the only 
process left to be compromised was recognition. 

The one variable that did show a significant difference 
between Imagination and perception was the assessment of ^he two 
recognition strategies of working forward and working backward. 
Imagining four elements reduced the probability of subjects 
working backward In this higher resource demanding condition. 

Why was there a shift In strategy? One reason may be that 
working forwards is a less resource dem nding strategy. Working 
forwards involves the generation and transformation of 
Information to produce a working memory representation that 
should automatically activate a letter recognition response. The 
letter recognition response is more of an automatic, data-driven 
process because It is similar to the automatic letter recognition 
involved in reading. In contrast, working backwards from the 
alphabet to the set of elements is more of an effortful, 
conceptually-driven process. Since working backwards has a 
greater resource demand, subjects could choose the less 
demanding, working forwards strategy to compensate for the more 
demanding imagination of four elements. Since only the 
Imagination group shifting to working forwards, a conclusion to 
draw is lhat imagination has a greater resource demand than 
perception. The inability to substitute imagination and 
perception was reflected by the type of recogition strategy even 
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though the data concerning the accuracy of strategies showed 
complete 5ubst 1 tutabl II ty . 

Experiment II 

In the first experiment, subjects had the choice of working 
forward or backward. It appears that suojects took advantage of 
this opportunity to work forward as a way of reducing cognitive 
resource demands when they had to Imagine four elements. In the 
second experiment, subjects were explicitly Instructed to work 
forward or backward when solving four-element problems. By 
restricting the type of recognition strategy, subjects would 
still have to find a compromise allocation of cognitive resources 
but changing the type of recognition process was not possible. 
If Imagination and perception are not completely subst 1 tu tab! e , 
compromising the accuracy of processes Is the only option. 

Subjects. 68 undergraduates from the C.S.U., Long Beach 
participated in the experlmer:t for course credit. 

Materials & Procedure The materials wtrre used In 
Experiment II as In the four-element, Imagination and perception 
conditions of Experiment I. The only dlf fence In the procedure 
was that subjects were given explicit Instructions on how to work 
forward or backward In identifying the imagined or perceived 
lines as letters. Half of the subjects were told that on each 
trial they should start by going through the alphabet, beginning 
with A and go in order to Z, and test if each letter could be 
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constructed from the elements presented. The other half of the 
subjects was to^d that on each trial, begin with the left-most 
line and go from left to right to test whether they could 
construct a letter from only one line, then from two different 
lines, and finally from three different lines. 
ReauLta 

As shown In Figure 4, the mean percentage of alphabetically 
ordered letters was high In the working backwards Instruction 
groups and was significantly greater than the working forwards 
Instri'Ctlon groups < £ (1,64}» 56.44, b <.05). Figure 4 also 
shows that there were no significant differences between the 
imagination aqd perception groups when they worked forward or 
backward < £ <1,26>< 1.0; £ <1,38)< 1.0, respectively). 

Overall, working backwards or forwards did not significantly 
improvethe Identification of one-line letters ( £ (1,64)= 3.05, 
p >.05>. There was no significant difference between the 
perception and imagination groups when they worked forwards < £ 
(1,26)< 1.0). But as shown in Figure 5, the perception group 
benefited from the strategy of working backwards. By working 
backwards, the perception group recognized a significantly 
greater percentage of one-line letters than the Imagination group 
< £ (1 ,38)= 11 .56, E <.05) . 

Figure 6 shows the mean percent correct construction of 
two-line letters. Overall, there was no slgnlflro..t difference 
t>etween working forwards and backwards ( £ <1,64>< 1.0). The 
perception groups constructed significantly more letters than the 
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Imagination groups when they worked backward as w«?ll as when they 
worked forward ( £ (1,38)= 6.00. e <.05; £ (1.26)= 5.90. ^ 
<.05, respectively). Comparisons of the one-line and two-line 
letters show that there were no significant differences when 
working forward ( £ (1.27X 1.0). Again, a different result 
occurred when subjects worked backward. Two-line letters were 
significantly less accurate than one-line letters ( £ (1.39)= 
14.75, E <.05). In sum, there were more similarities between 
Imagination and perception when subjects worked forward as 
compared to when subjects worked backward. 
JQiacusslon 

The Instructions to work forward controlled the type of 
recognition strategy both imagination and perception subjects 
used to Identify letters. Comparisons of the alphabetic scores of 
the working forward groups of Experiment II and the four-element. 
Imagination group of Experiment I indicate that the latter group 
was working forward as was proposed. When the working forward 
subjects In Experiment II had the simple task of Identifying 
one-line letters. Imagination and percept Ion were subst 1 tutabl e 
processes. Even though four elements presented, working forward 
subjects would start each trial by examing one element at a time. 
Thus, only one element had to be maintained in working memory and 
cognitive demand difference between Imagination and perception 
did not affect the accuracy of the generation and recognition 
processes. As found In Experiment I, Imagination and perception 
were substl tutabl e when a task is low in Its cognitive demand. 
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Once working forward subjects had the additional demand of 
transforming the four lines, the lower demand of perception 
produce^; more accurate letter Identification. The results 
indicate that the transformation and generation processes were 
not compromised because there was no difference between one-line 
and two-line letters when working forwards. To optimize 
resource allocation, subjects couldn't change the type of 
recognition strategy so they had to compromise the accuracy of 
the recognition strategy. 

There were a number of differences between working forwards 
and backwards. First, Imagination subjects were less accurate 
at Identifying both one-line and two-line letters when working 
backwards. Indicating that Imagination was not subst 1 tutable with 
perception In Identifying either the simple or complex letters. 
Second, two-line letters were Identified less frequently than 
one-line letters when subjects worked backward. The process of 
transforming the elements appears to have been compromised by the 
more cognltlvely demanding strategy of working backwards. 

The accuracy of one-line letters In the working backwards, 
perception condition Is also comparable with the accuracy of 
one-line letters In the two-element condition of Experiment I. 
If the performance level of the two-element condition represents 
the performance celling due to data-1 1ml tat Ion factors, then 
working backwards appears to maximize performance In this 
cognltlvely demanding circumstance. The reason for this may be 
that working backwards probably ensured that all letters were 
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available to compare with the presented set of lines. This 
benefit had a 'cost . Imagination could not completely substitute 
for perception when subjects were forced to use the more 
demanding strategy of working backwards. 

Conclusions 

Two experiments demonstrated that the subst 1 tutabl 1 1 ty of 
Imagination and perception can be Influenced by a number of 
factors, many of which are related to the cognitive demand 
difference of Information from these two origins. The results 
suggest that subjects decided to shift the accuracy level and 
type of recognition strategy in accordance with the problem 
demands. When problems had a low demand, the similarities 
between Imagination and perception resulted in a high degree of 
subst 1 tutabl I Ity. But when the problem demands exceeded the 
Individual's limited resources, the differences between 
Imagination and perception reduced subst 1 tutabl I I ty . Subjects 
using Internally generated Information consistently choose a 
different compromise of accuracy and strategy than subjects using 
externally generated Information when engaging the more demanding 
working backwards strategy. To make these choices, the 
individuals must perform metacogni t 1 ve assessments of a task's 
demands and allocate cognitive resources in an attempt to 
optimize problem solving success. In addition to defining a 
problem's Intltlal state, goal state, and problem space, the 
solver must consider the availability of cognitive resources and 
budget 1 ts al locat ion . 
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The dissociation of accuracy and strategy measures in both 
experiments reinforces an important methodological issue in 
studying the similarities between imagination and perception. 
Researchers should employ multiple performance measures in order 
to completely describe the cognitive processing of Information 
from our Internal and external origins. The multiplicity of 
cognitive processes that are coordinated In the performance of a 
task present people with a wide variety of options to choose 
their compromise. The subjects' compromises, dictated by the 
particulars of the task, might severely reduce the generalization 
of findings and theories if too few measures are used. 
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Footnote 

1. In a factorial design, the traditional sources of variance, 
main effect of A. main effect of B, and the Interaction of A X B, 
can be repart 1 t loned Into the independent sources, B at each 
level of A, and the main effect of A (Keppel , 1982). The second 
method of variance partitioning was used for the present 
experiments because It directly answered the questions concerning 
the differences between Imagination and perception under 
different cognitive demands. Thus, the three 1 df test for the 2 
X 2 design were: (a) the difference between the imagination and 
perception for two-element problems, (b) the difference between 
the Imagination and perception for the four-element problems and 
<c) the overall difference between the two-element and 
four-element problems. This statistical design was use to 
analyze both the percentage of correct responses and the 
percentage of responses that were alphabetically ordered. 
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